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Adaptive Density Estimation on the Circle by 
Nearly-Tight Frames 


Claudio Durastanti* * 


Abstract This work is concerned with the study of asymptotic properties of non- 
parametric density estimates in the framework of circular data. The estimation pro¬ 
cedure here applied is based on wavelet thresholding methods: the wavelets used are 
the so-called Mexican needlets, which describe a nearly-tight frame on the circle. 
We study the asymptotic behaviour of the L^-risk function for these estimates, in 
particular its adaptivity, proving that its rate of convergence is nearly optimal. 
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1 Introduction 

In this work, we aim to study nonparametric estimation of a density function F based 
on directional data, sampled over the unit circle S', by thresholding techniques, 
focussing in particular on the adaptivity for the associated L^, the so-called mean 
integrated squared error. The estimators are built over a wavelet system, namely the 
Mexican needlets, which describes a nearly tight frame on S' and characterized by 
strong localization in the spatial domain. Directional data over S' can be viewed 
as angles measured with respect to a fixed starting point, the origin, and a fixed 
positive direction. They can be described as aset of points {A,,/ = 1,...,«}, lying on 
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the circumference of S*; for this reason, they are also called circular data. Circular 
data are characterized by the 2;r-periodicity, which has led to the development of 
a huge set of circular statistical methods, independently from the standard real-line 
statistics. These investigations can be motivated also in view of the large number of 
applications in many different helds, as for instance geophysics, oceanography and 
engineering. The textbooks [141 can provide a complete overview on this topic 
and further technical details (see also iiini), while some applications of interest 
can be found in li2l[5l l2ni22l[T4l . 


1.1 Overview 

In the recent years, the literature concerning density estimation problems is becom¬ 
ing more and more abundant; in particular, we are referring to the study of the adap¬ 
tivity results for -risks in the nonparametric framework. Consider a function F 
belonging to some scale of classes called nonparametric regularity class of 
functions and depending on a set of parameters a G A, and its estimator F: this esti¬ 
mator is said to be adaptive for the L^-risk and for if for any a G A there exists 
a constant Ca such that 


F-F 


Z.2(S1) 


^ CaR, 


•n 


where n is the number of sampled data and R, 


n (f,. 


is, loosely speaking, the 


worst possible performance over ^a- it is said to be minimax if R, 


‘n{F, 


= 


ink 




F-F 


Z.2(s‘) 


, where F ranges over all measurable functions of the 


observations {Xi,i = 

Nonparametric minimax estimation of unknown densities or regression functions 
was presented in the seminal paper 16], see also 13: in this work, optimal minimax 
rates of convergence of the L^-risk were obtained by nonlinear wavelet estimators 
based on thresholding techniques. Since then on, many applications were developed 
not only in Euclidean spaces but also in more general manifolds: we suggest as 
textbook reference Il20l . As far as data on the unit q'-dimensional sphere are con¬ 
cerned, many of those researches have been developed by using the constructions of 
second-generation wavelets on S'? named spherical needlets. The spherical needlets, 
introduced in the literature by li^lZTl . feature properties fundamental to attain the 
minimax optimal rates of convergence of the estimates, such as their concentration 
in both Fourier and space domains: density estimation of directional data on S'? was 
presented in fJI, the analysis of nonparametric regression on sections of spin hber 
bundles on S^ by the means of spin needlets was proposed in lH and, hnally, non¬ 
parametric regression estimators on the sphere based respectively on needlet block 
and global thresholding were studied in Oil and 03. 
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1.2 Motivations and comparisons with standard needlets 

The main result here established concerns nearly-optimal rates of convergence for 
the L^-risk of nonparametric density estimation based on wavelet coefficients on S*. 
The wavelets considered are the so-called Mexican needlets, introduced on general 
compact manifolds in 11511161 El na, see also niiiii. These wavelets are known 
to enjoy very good localization properties in the real domain, as described in details 
below in Sectionl^(see also ifTOl l. while their support is not bounded in the harmonic 
domain, on the contrary of standard needlets. Furthermore, while standard needlets 
are built by using a set of exact cubature points and weights (cfr. ED), Mexican 
needlets are built over a set of points satisfying weaker restrictions (see El and 
Theorem IT] below). Indeed, Mexican needlets can be built over any partition over 
their spatial support with area monotonically decreasing with the resolution level. 
In this sense, statistical techniques adopting Mexican needlets are more immediately 
applicable for computational developing; some examples of their practical applica¬ 
tions in the field of statistics can be found, for instance, in 0 [121 |23j |^ [^ . On 
the other hand, Mexican needlets lack an exact reconstruction formula, so that the 
corresponding density estimators are biased. The main purpose of this work is to 
show that thresholding procedures built on Mexican needlets behave asymptotically 
as those constructed with standard needlets (cfr. lO), on the other hand offering 
advantages both from the practical and the theoretical points of view, such as the 
easier construction of the wavelets over partitions on S' and the stronger localiza¬ 
tion properties; their bias is proved to be asymptotically negliglible (see Theorem]^ 
below and numerical evidence in Section|5] 


1.3 Statement of the main result 

Given a set of i.i.d. circular data {X,-,/ = distributed over S' with density F, 

and the set of circular Mexican needlets, {\l/jq-,s (0), 0 € S'}, whose definition and 
main properties will be given below in Subsection |2.1| a threshold wavelet estimator 
F for the density function is given by 

^(0) = E E Cj,MPjq-,K¥j,;sK(e ), 0 e s', 

j=Jo‘/=l 

where denotes the threshold, jSjy-sK the unbiased estimator of the wavelet 

coefficient corresponding to ¥jq;sK{0), K is the cut-off frequency; further details 
can be found in Section [3] We choose Besov spaces, labelled by ,, as nonpara¬ 
metric regression class of functions, (cfr. Subsection |2.2[ ), so that Theorem [^ will 
prove that 
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sup E 

Fe^k, 


F-F 


2 

L2{S‘)_ 


= 0 „ 




( 1 ) 


where r is one of the smoothness parameters characterizing the Besov space. Ob¬ 
serve that the results here obtained are consistent with the ones already existing 
literature, cfr. for instance 13 0 nmol. We stress again that the estimator F is char¬ 
acterized by a bias due to the lack of an exact reconstruction formula: the nearly- 
tightness of ^ {9) ,0 € S'} assures the bias to be negligible with respect the 
rate of convergence on the left hand of Q, since it is controlled by some parameters 
depending on the number of observations n. All the details can be found in Theorem 
We stress again that the study of the asymptotic behaviour of the bias is one of the 
most relevant results attained in this paper, because it represents the main difference 
between density estimates here defined and the ones built on standard needlets (see 
again 0). 


1.4 Plan of the paper 

Sectionj^introduces the circular Mexican needlets, their main properties and a quick 
overview on circular Besov spaces. In Section we describe the nonparametric 
density estimates built on circular Mexican needlets, while Section [^describes our 
main results: Theorem]^ concerns adaptivity of the threshold density estimator F 
and Theorem [^exploits the upper bound for the bias of F. Section [^provides some 
numerical evidence, while in Sectionj^we collect all the auxiliary results related to 
the two main theorems and some ancillary results on circular Mexican needlets. 


2 Nearly-tight frames on the circle 

This section will provide details concerning the construction and properties of Mex¬ 
ican needlet frames over S' and the definition of circular Besov spaces in terms of 
their approximation properties. 


2.1 Harmonic analysis and circular Mexican needlets 

In this subsection we will describe some results, already well-known in the litera¬ 
ture, related to Fourier analysis and the construction of the Mexican needlets over 
the unit circle S'. More details on Fourier analysis can be found, for instance, on 
the textbook ll32l . while Mexican needlets and, more in general, nearly-tight frames 
over compact manifolds were introduced in the literature in ifTSl fT0 flTl [TSl . see 
also iniiii. Furthermore, we present also a simplified statement of the localiza- 
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tion property in the spatial domain for Mexican needlets over S*, described more 
extensively in Lemma[T](see also GolEl). 

Let us denote by L? = L?' (S\ dp') the space of square integrable functions over 
the circle with respect to the Lebesgue measure p (dO) = (27r) * c/0, on which we 
define the inner product as follows: for/,g G (S^,c/p) 

{f,g) = (/,g)^ 2 (§t) = J^j{0)i{^p (dO ), 

As well known in the literature, the set {wjt (0),0 G G Z}, Uk{x) = exp [ikd), 
describes an orthonormal basis over S', whereas the Fourier transform is given by 

1 /■ 2 ?r _ 

f{o)uk{e)de, 

and the corresponding Fourier inversion is given by 

/(0)= ^ct,«,(0) ,0 gS'. (2) 

kel 

Furthermore, •{Mi(0),0GS*,/:GZ} can be viewed as the eigenfunctions of the 
circular Laplacian A corresponding to eigenvalues —k^ (for more details, see for 
instance ll24ll '). For F G '^he quantity 7 ^ is given by 

7k--=\ak\^, (3) 

so that 

Lrk = L\^^\" = Ml2(sA- 

kez kez ^ ^ 


Remark 1. Since 



< 00 , the sum Y.ke'L 7k has to converge, therefore 


lim Yk = 0 , 

|A:j—^00 

lim \ak\ = 0 . 

j/cj—>00 


Let us now introduce the Mexican needlet system. Let the weight function w*: M i-A 
K+ be given by 

Wi(x) :=x^exp(—x) ,.r G K, (4) 

so that, from the Calderon formula and for t G M+, it holds that 


r, f. r{2s) 

while (see mi) using the Daubechies’ criterion leads us to 
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weight function ($s3) 



Fig. 1 the weight function Wj (x^) for s = 3. 


^ \ws{tB ^■')| <Ab,sMb, 

where, for the scale parameter B> 

AB,s = es (21ogB)^', 

(l+C>B(|B-l|2log|B-l|)), 

™5=(l-OB(|B-lplog|B-l|)). 

For any resolution level j G Z, let {Ejq} , q = 1 ,... ^Qj be a partition of S', such 
that Ejq^ f^Ejq^ = 0 for qi ^ q 2 . Any Ejq is characterized by the couple {Xjq,Xjq): 
Xjq = p {Ejq) describes the length of Ejq, while Xjq G Ejq is a point belonging to 
Ejq. For the sake of simplicity, we can think to xjq as the midpoint of the segment 
of arc Ejq. Fixed now the shape parameter s S N and the scale parameter B > I, the 
circular Mexican needlet ^jq-.s : S' i—)■ C is given by 

¥jq;s{Q) ■= ^ wJ{B^^k)^)ui,{xjq)uk{e) 

k=-oo ^ ' 

= 'Ihq L i^-Xjq )), 0 e s'. (5) 

* k=-oo ^ ' 

For any F G (S'), the needlet coefficient Pjq-,s G C corresponding to ^fJq■.s is 
given by 

pjq-.i ■= {F, Wjq-,s}i2^si'j ■ 


(6) 
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Mexican needlet (jss, b:1.3, ss3) 



Fig. 2 The Mexican Needlet with i = 3,5 = 1.3,7 = 5 centered on the pointXj,j = K. 


The next result, here properly fitted for was originally proposed as Theorem 1.1 
in 021: it proves that the Mexican needlet framework describes a nearly-tight frame 
on the manifold. We recall that a set of functions {e,, / > 1} defined over a manifold 
M is a frame if there exist ci ,C 2 > 0 so that, for any F G (M), 


Cl |lf|li2(M) < L < C2 I1 ^"IIl2(M) 


A frame is said to be tight if ci = C 2 . An example of a tight frame over the d- 
dimensional sphere is given by the standard needlets, introduced in the literature 
in Il26ll27l . A frame is nearly-tight if C 2 /C 1 ~ 1 + £, where e is close to 0, cfr. ifThll . 

Theorem 1. (Nearly-tightness of the Mexican needlets frame - Th. 1.1 in SIH) 

Fixing B > I and cq, 60 >0 sufficiently small, there exists a constant Cq as follows: 

• forO 1 , suppose thttt for cQch j ^ Wj, there exists o. set of ineosurcible sets 

{Ejq,q = with ^ where: 

- Xjci<riB-i; 

- for each j with rjB ^ < 5o, Xjg > CO (t?B ^)forq= 

• it holds that 


If{AB.,mB-Corj) > 0, then {Wmx} 


Qj 

E \Pj,-.s\^<iAB,.MB+Cori) ll^'ll"2(si). 


is a nearly tight frame, since 


{Ab.sMb + CqT]) 
{Ab^sOIb — CoTj) 


-^ = l+OB(\B-l\hog\B-l\). 
mn V / 
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Mexican needlets can be thought as an alternative approach to the standard needlets, 
proposed in EbllZTi . see also 0|24l, in views of their stronger localization property 
in the real domain. Standard needlets feature a quasi-exponential localization prop¬ 
erty in the spatial range, while the weight function Ws leads to a full-exponential 
localization in the real space as proved below in Lemma[2(cfr. ifTOlITTl l. As far as 
the frequency domain is concerned, while spherical needlets lie on compact support 
(see again MWl), each Mexican needlet has to take in account the whole fre¬ 
quency range. This issue is partially compensated by the structure itself of the func¬ 
tion Wi, exponentially localized around a dominant term in the frequency domain 
and, therefore, consistently different from zero only on limited set of frequencies. 
For our purposes and in order to respect the conditions in Theorem [T] we impose 
the following 

Condition 1. . Let ((^) cind s be given respectively by 0 and 0- Wfe have 
that, for j > 0 

so that 

w,({B-jkf)exp(ik(e-xjA (7) 

k=-OC ^ ' 

Furthermore, we choose Jo < — log^ ^/s and fix do such that do < Hence, we 

have, for j < Jo, 

Qj = 1, = 2n. (8) 

Mexican needlets are characterized by the following localization property, proven 
in Lemma [T] 

From the localization property, it follows a bound rule on the norms: there exist 
CpjCp >0 such that 

The proof, totally analogous to the case of standard needlets (see lIZTl l. is here omit¬ 
ted. 

Remark!. The choice of ([^ is justified as follows. First of all, observe that, for any 
j < Jo, Xjq still satisfies Theorem[^ Furthermore, when j is negative, the grows 
to infinity, hence there exists some J' <0 such that do < rjB^'’ ■ It implies that the 
has to be smaller than a quantity bigger than 4;r = p (S'), corresponding to the 
case Ejq = S', which leads to Qj = 1, so that we have that QjXjk « 1. As far as the 
choice of Jo is concerned, if Jo < — log^y^s, it means that, for any k, 
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and therefore Ws^kB j < Ws (s) — max^gR (r). As consequence, taking into 
account Lemma 2 we have that for any k, Xs,b,Jq {k^) « 2^^''F (2s) = 

Remark 3. While in ifTSl fThlflTlfTSl the Mexican needlets are defined as (0) = 
y/-jq (0), 0 C S*. We use this notation to uniform this work to the already existing 
literature on the field of statistics based on needlet-like framework. 


2.2 Besov spaces on the circle 

In this subsection, we will recall some of the results proposed in flSl (see also ||20l 
1221) on Besov spaces, in terms of their approximation properties. More in details, 
let Fir be the space of polynomials of degree r: we start by looking for the infimum 
of the V’ (S^) -distance between a function / : S* i-A K and the space FI/. 

G,(/,P)= mf 

Following, for instance, ||3l|8][l8l|22l, let F £ if and only if both the following 
conditions hold; 


(0 F e L™ (s') , (ii) (m^G„ (/,f))^) ^ , 

or, equivalently, 

(0 F e L™ (s') , (ii) {B-J^Gj,j {f,P)y 

As shown in ifTSl . see also 13, it holds that, for \ <m<°°,r>0,0<t<°°, f£ 
I if and only if 



Qj 


52 \Wjk-,s 


< B J''5j, 5j £ Ir. 


Il"'(s>) 

In what follows, we will make extensive use of this inequality with m = 2: 


Qj \ ^ . 

52 II’^A;s|Il2^§i) 1 — ( ^2t? 52 (10) 


Further details on Besov spaces can be found in lIZTl and in the textbook Il20l . 
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3 The density estimation procedure 


In this section, we will introduce a thresholding density function estimator on the 
circle based on the Mexican needlet coefficients. As already mentioned, thresh¬ 
olding techniques were introduced in the literature by D. Donoho and I. John¬ 
stone in to be later successfully applied in several research topics: for an ex¬ 
haustive overview and details we suggest the textbooks ll20l and lf3^ . Consider 
a set of random directional observations {jf, €S*:/=l,...,n} with common dis¬ 
tribution v{9) = F (9) d9 and let us introduce the threshold function := 

1 {|^ |>k:t }’ where if is a real-valued positive constant to be chosen to set the size 

of the threshold (cfr. ||3). The coefficient estimator is given by 

” (=1 


which is unbiased, i. e. 

E 


^jqK-s = ^jq-sRp {d)d9^ fijqK^s■ 


Consequently, the thresholding density estimator is given by 

P (0) = L C;? M PjqK-syfjq-,sK (9) , 9 G S\ 

7=70 <?=1 


( 11 ) 


where J„ and K„ represent respectively the truncation resolution level and the cut-off 
frequency. The truncation level is chosen so that as usual in the litera¬ 

ture (see for instance EEl), while the cut-off frequency is fixed so that Kn = ^ 

. The other tuning parameters of the Mexican needlet estimator to be considered are: 


• the threshold constant K, whose evaluation is given in the Section 6 of ll3l: 

• the scaling factor T„, depending on the sample size, chosen, as usual in the liter¬ 
ature, as = (logn/n)*^^; 

• the pixel-parameter 77„ = 77, chosen so that ?]„ = 0„ {n^ ^ ^. 

We will present our main result concerning Mexican thresholding density estimation 
in the next Theorem. For the embeddings featured by the Besov spaces, as in Q, 

I 

the condition r > - implies that F G , C t"‘ ■■ so that F is continuous. 


Theorem 2. For \ <m = t < 2, r>^, there exists some constant Cq 
such that 


sup E 


F-F 


2 

L2(S1)_ 


< Co log « 



2r 

2r+l 


Co (m, r) 


(12) 


Remark 4. To attain optimality, it should be necessary to show also that 
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sup E 


Z7 Z7 

2 

r — r 

L2(S‘)_ 


>C* 



This lower bound is entirely analogous to the standard needlet case in Q, Theorem 
11 , and therefore its proof is here omitted. 


4 Proof of Theorem |2] 


In this section we will provide a proof for Theorem based on the main guide¬ 
lines described by D. Donoho and I. Johnstone in ||6l, cfr. also 13 and the textbooks 
EiEa. The procedure illustrated by |[3 IS El fits perfectly for tight wavelet sys¬ 
tems, which feature an exact reconstruction formula. As already discussed in Sub¬ 
section 2.1 Mexican needlet are not characterized by tightness, hence the bias term 


appearing in the study of ( [T2] > will also take into account addends due the (deter¬ 
ministic) error raising when we approximate a function with its wavelet expansion. 
The decay of these terms will depend on the choice of the pixel-parameter Tj„, on 
one hand, and of and K„ on the other hand. We will start by developing an upper 
bound for the bias term, which represents the main difference between the estima¬ 
tion procedure here discussed and the one based on standard needlet frames. 


4.1 The bias: the construction and the upper bound 

We recall from ini the so-called summation operator S, leading to the summation 
formula. The summation formula can be viewed as the equivalent in the Mexican 
needlet framework of the reconstruction formula in the standard needlet case (see 
for instance SHI): for any F G L? (S*), let the summation operator be 

given by 

oo Qj 

S [^’]. (0) E L (0) , 0 e S'. (13) 

j=Jaq=\ 

The goal of this subsection is also to estimate which terms in the sum above are so 
small that they can be neglected. We will fix a cut-off frequency K, to compensate 
the lack of a compact support in the harmonic domain typical of standard needlets 
(see ca), to define the truncated Mexican needlet, and a truncation resolution level 
J. Theoremj^will exploit an upper bound, depending on s, J, K and 77 , between ( [T3] > 
and the truncated summation operator defined below. Observe that these results are 
general and not related to the specificity of the estimation problem: in this sense, 
when the label n 'm K and J is omitted, we intend that the claimed result holds in 
general. 

First of all, given S N, the truncated Mexican needlet '^fjq-.sK is given by 
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Wjq-,sK{Q) ■■= ^ wJ{kB ^f\uk{^jq)uk{d) , 9 & , ^jq € E jq , 

\k\<K ^ ' 

and the corresponding truncated needlet coefficient jijq-^sK is defined 

Pjq-sK ■= {F,\l/jq-sK)[ 2 (^§l'j ■ 

Loosely speaking, fixed K, \l/jt,sK ( ) is the Mexican needlet where all the elements 
out of the support [—Ai,/r] are not taken into account. The truncated summation 
operator 5 [F]^ ^ y is therefore given by 

J Qj 

S[FI,kjW := L L lijq;.KWjq-,sKi9) , 0 G s'. (14) 

j=Joq=i 


Remark 5. Following Remark]^ we will truncate in ( [T4l l all the negative resolution 
levels i <Jq. 

Let the bias Rs.kj.t] be given by 


R 


s,KJ.rf 




z.2(si) ’ 


(15) 


An upper bound for Rs^kj is explicitly provided in the next Theorem. 

Theorem 3. Let Rs^kj be given by Then, there exist Ci,C 2 ,C 3 > 0 such that 

Rs,k.j < exp {-K^) 




\k\>K 


Proof. Using the Minkowski inequality, we have 





< /l + /2 + /3, 


where 
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h- = 


oo Qj 


j=Joq=l 


J Qj 
j=jQq=l 


L 2 (S') 


h ■= 


j Qj 

j=Joq=l 


J Qj 

H ^ Pjq,s¥jq-,S;K 
J=Joq=i 


L2(S1) 


b ■= 


J Qj J Qj 

H H Vjq,sK ~ 52 52 ¥jq;sK 
J=Joq=i J=Joq=i 


L2(S1) 


Observe that while /i describes the bias due to the truncation of the resolution levels 
belonging to h and depend strictly on the choice of the cut-off frequency 

K, due to the approximation error due to approximate Mexican needlets by the cor¬ 
responding truncated ones (the former), and Mexican needlet coefficients by the 
corresponding truncated ones (the latter). According to Lemma|^ we get 

h < 


As far as h is concerned, from Lemma|^ we obtain 

/2 <C27zii:^"^Zexp(-/:2)B^(''+^*^zV . 

Finally, from Lemma it holds that 

\\k\>K J 


as claimed. 

Remark 6. An analogous result is obtained in Theorem 2.5 in im (see also Lemma 
2.3 in ifTbl ). In these works, the authors use a generic weight function belonging to 
the Schwarz space and, moreover, the wavelets studied are defined over a general 
compact manifold. For this reason, the bound exploited in Theorem]^ using explicit 
bounds provided by Ws and by the basis {m*.}, is more precise. 


4.2 Adaptivity of F for the L^-risk 

Merging the results achieved in the previous subsection with the ones driven by 
the standard procedure in the case of nonparametric thresholding density estimation 
(see for instance ||3), we obtain the following proof. 

Proof (Proof ot the Theorem^. Observe that, for the triangular inequality, we have 
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E 


F-F 


L2(S1)_ 


=E 


F-S[FI,k„,j„ +S[Fi^K„,j„-S[Fi + S[Fl-F 


l2(S')_ 


< £1 +£2 +-£'3 J 


where 


£1 = E 


F S [F],^k„,j„ 


L2(S1) 


£2 = £ 


s.KfjjJfj 


£3 = ||5[£L-£||22(si) . 

As far as £1 is concerned, the bound is established analogously to the one achieved 
in |[3l, hence here it is given just a sketch of this proof in Lemma|^(see also ||8l). 
Indeed, we have; 


£1 = E 


F * 2 j 

^ Pjii-,sK„ — Pjci-,sK„ 


./=()</= 1 


Jn 


y^jq,sK„ 


< ( 7 „ + l)^E 


j=o 


L2(S1) 

(j^jq i'^n) Pjtj-,sK„ ~ Pjy,sK„'^ Wjq-,sK„ 


9=1 


L2(s1) 


< 


j,. Qj , 

(-/n + 1 )^ ^ l|v^;9;-«^n|lL2(§i)® 
2 = 09=1 ^ ^ 


Ci9 i'^n) Pjq-,sK„ Pjq-,sKn 


Jn Qj 


< (y„ + l)C 2 t 7 „^ ^E 

2 = 09=1 

< Ci7„ (£ 1 J +£ 1,2 +£ 1,3 +£ 1 , 4 ) , 


^iq ('^n ) Pjq-,sK„ Pjq;sK„ 


where 


Jn Qj 


Fl.l —tin 52 52 ® 
2 = 09=1 

Jn Qj 

El,2 =J?n 52 ® 

2 = 09=1 


Cjq () Pjq-,sK„ l^jqMn 


Cjq () PjqisKn Pjq-,sKn 


( 16 ) 

^ { \Pjq-..<K„ I > ITT,,} ^ { I Pj‘r.sK„ \<'^} ’ 

(17) 


Jn Qj , 

£ 1,3 =rin ^ 52 \Pjq-,^K„\ IE 
2 = 09=1 

Jn Qj , 

£i.4=r7«E52lfe;.*^»rE 

2 = 09=1 




( 18 ) 

( 19 ) 
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Heuristically, the cross-terms £12 and £13 are bounded by means of fast decays 
of the probabilistic inequalities given in Lemma 10 while as far as £11 and £14 
are concerned, their bounds will be exploited according to the tail properties of the 
Besov spaces: further details are in Lemma|^ From these considerations, it follows 
that 

/ n 


E\ < C\ 


\logn 


2r 

-JFfT 


As far as £2 is concerned, from Theorem]^ it holds that 
£2 = < 


+ ?exp(-2£2) ^ 

\\I<\>K„ J 


Observe that 


while 


B 


_ 


logn 


< 


logn 


Ir 

2r+I 


C 2 j\Kn ^ exp (-£,?) £-('■+ 2 *- 2 < 


n 2r+l 


logn 




n 2r+l 


logn 


Finally, we have 
whence, for r > 1 , 




T]n<n ? < 


3 2r 

4 ^ n 2 ?+i 


logn logn 


5 Numerical results 

This section presents the results of some numerical experiments. Obviously, in the 
framework of finite sample situation, the asymptotic rate given in Theoreml^has to 
be considered just as a prompt. In what follows, we have built an estimator pT) us¬ 
ing the set to estimate £ (0) = (27i:)^' exp f(0 — nf' /2^ by using CRAN R. Some 
graphical evidence can be found in Figure!^ We will focus on two main points: 

• the number of coefficients surviving to the thresholding procedure depending on 
K and T„. 










16 


Claudio Durastanti 



n=8000 

n=12000 


j\K0 

0.10 

0.15 

0.20 

0.10 

0.15 

0.20 

Tot 

0 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

2 

2 

3 

3 

3 

3 

3 

3 

2 

3 

4 

4 

4 

4 

4 

3 

3 

4 

5 

5 

4 

4 

5 

5 

5 

5 

6 

8 

7 

6 

8 

7 

6 

8 

7 

11 

10 

10 

10 

10 

9 

11 

8 

13 

11 

11 

13 

14 

14 

15 

9 

19 

14 

12 

20 

21 

18 

21 

10 

17 

4 

3 

28 

12 

10 

29 

11 

NA 

NA 

NA 

7 

2 

0 

40 


Table 1 number of mexican needlet coefficients surviving thresholding for various values of n, j 
and Kq. 



n=8000 

n=12000 


0.10 

0.15 

0.20 

0.10 

0.15 

0.20 

L^-risk 

0.481 

0.468 

0.451 

0.458 

0.432 

0.331 


Table 2 L^-risk for various values of n and Kq. 


• the estimate of the L^-risk function 
observations n. 


F-F 


L2(S1) 


depending on the number of 


In particular, following 13 , we have chosen K = (Co-v/O-lO?supg^gi |f (0)|, with 
Kq = 0.05,0.1,0.15,0.2, and n = 8000,12000, leading to fCgooo = 30, K 12000 = 36, 
■/gooo = 10, /12000 = 11, fsooo = 0.0335 and fi 2 ooo = 0.028. The Table|^counts the 
number of coefficients survived to thresholding. A qualitative analysis confirms that; 
(i) as n 00 , tn is decreasing so that the threshold is lower and more fijq-s survive to 
the thresholding procedure and (ii) if Kq increases, the number of surviving coeffi¬ 
cients is smaller, expecially at higher resolution levels. 

The Table describes the estimates of the -risks for any choice of Kq and any 
n. As expected, the L^-risk is decreasing when n grows and it is increasing with 
respect to (Q) (cfr. El) 


6 Auxiliary results 

This section contains all the statements and the proofs of the auxiliary results used 
to prove Theorem]^ and Theorem 
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Fig. 3 Graphs of the thresholding estimator (on the left) and of the linear (not-thresholded) esti¬ 
mator (on the right) for n = 12000 and s = 3. 


6.1 Properties and Inequalities for Mexican needlets 


The first result here presented concerns the concentration property of the Mexican 
needlets in the real domain. 

Lemma 1. For every 0 g S*, s > 1, there exists c* such that: 


I (^) I — y exp I 


B^i^-Xjq) 



(0 Xjq) 



Furthermore, if j > 0, it holds that 


\Vjq-,A0) \ < CsrjB^exp - 


B^ {9 Xjq) 


B^ (9 Xjq) 



Proof. This proof follows strictly the one for standard needlets developed in ll26l 
and the one for Mexican needlets on in ifTOll . see also ED. First of all, from Q 
observe that we can define a function : M i—>■ K+ such that W, (x) = (x^). We 
can therefore rewrite Q as follows: 


Wjq\s (9) — y^jq 52 SBi,e-Xjq (^) > 

k=—oo 


where 

8Bj.e.xj, («) := exp {iu {9-Xjq)). 

For the Poisson summation formula (see for instance ll^fT0ll24l '). we have that 
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E SBJ.e.x:Ak)= E 


k=- 


SbKb^ 


{2nv), 


where the symbol ^ [g] denotes the Fourier transform of g. In our case, we have 




SBLBxj^ 


(co) = ^ [VFi {uB ■')] * ^ [exp (iu {d —Xjq ))], 
where the symbol * denotes the convolution product. Standard calculations lead to 

^ I"- (^) “P (- (^)y 

^ [exp(/M {9 —Xji^))] = 'Jin?) {{9 —XjJ — co). 

Hence we get 




SBifi,Xjq 




B-} 


IB-} 


exp 


{9-Xjc,)-(0 

IB-} 


Following Proposition 2 in Gol, we have that 


E ^ 


gBi.e- 


(Inv) <C 2 sB^ exp - 


Bj9 Xjq) 


His 


BJ9 Xjq) 


It can be easily proved that 

, B}{9—Xjq) 

^Is 


1 + 


Bj9 Xjq) 


2s\ 


see for instance im. Straightforward calculations lead to the claimed result. 

The next results will be pivotal to truncate negative resolution levels and the fre¬ 
quencies k: I A: I > in the summation formula. 

Lemma 2. Let w* : M i—)■ M+ be given by 0. Let Jq G N. Hence, for t > 0, it holds 
that 

-Jo 

.... ^ " ( 20 ) 


where 


^f \wJtB-H)f = ?^0^[l±o[\B-l\hog\B-l\))^ 
Xs,BjJt):=2-^^r (2s,2tB^y 


Furthermore, it holds that 




i=Jo 


( 21 ) 
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where 




’)■ 


Proof. Let us start by proving ( |20| ). First of all, observe that the following identity 
holds: 


L 


dx 


•^0 \ 


i |w, {tx)f — = 2-^^r 2s,2fB>»g« = Xs.BJo (0 • 

X \ J 

Applying an analogous procedure to the one adopted in Lemma 7.6 in na, dehne 
the function Gj: K i-A IR+ by 

G.(M):=|w.(e“)|2=e-2^"(i-“""). 

Let / = — j, and hx f = e'', v > 0; on one hand we get 

£ Ws(tB^j') = £ wJe'^j'+A = £ Gs{df + v), 

f=i. j'=jo :'=i^ 


J'=h 


j'=Jo 


d = 21ogB. On the other hand, for u — log.r, we obtain 



As in Lemma 7.6 in ua, note that dJfj/^j^^Gsidf +v) is a Riemann sum for 
J°°Jq Gs{u + v)du. Moreover, because L/=/ Gs{df + v) is periodic with period 

d, it is sufficient to estimate this sum just for 0 < v < d. Now observe that, for 
J = Jo + AJ, AJ > 0, we get 


d ^ G,{di' + v)-Xs.BJa{t) 
f=Jo 


< 


d Gs(df + v)— [ Gs{u + v)du 
;Wo 

J |•Jd+^ 

d^Gs{df + v)— Gs{u + v)d^ 

j'=h 


+d X Gs{dj' + v)+[ Gs(u + v)du. 
,7^, Jjd+i 


j'>J 

Using the midpoint rule, (see again Lemma 7.6 in ITSl '). we obtain 

J « d 


rJ u + 2 

H i' + ^) ~ / Gs(u + v)du 

j'=Jo "o 


•Jd+i 


<^\\G''\\AJ-h)d\ 


On the other hand, observe that, for r > 0, 


— (l—sre '')=se '’(r—1), 
dr ^ ' 
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SO that (1 — sre^'') is monotonically decreasing for r G [0,1), it attains its minimum 
for r = 1 and then it is monotonically increasing for r G (1,°°)- Observing that 
(1 — sre^'')^^Q = 1 and limr-^oo (1 — sre^'') = 1 yields to 


G.(r) 

Consequently, for f = expt//, we obtain 


d ^ Gj {df + v) <Y^e 
i'>J j'>J 


-2e^i'+'’ 


^ E ^ 

j">QX'pdJ 


-2e"j" _ e 




e2«’'-l ’ 


which, for y = 2e"+‘’, leads to 

/ Gs{u + v)du = j 
Jjd+i Jji 


Jd+^ 


-2c"+'' 7 

e du 


L 


-ydy 
2/''+2+*'^ y 




Therefore, there exists a constant C > 0 so that 

G,{df + v)-^ 

j'=Jo 

<c(AJd^+e^^^''^ < C'AJd^. 

According again to ca, we choose AJ € {\og{\/d) /d^2\og{\/d) /d) so that 




(0 


< — ||g"| 

- 24 II I 


AJd^ 


2e\\-edJ) 


ole'- 


-1 


E 


Xsfijfy {t) 

d 


< C' 2c/log 



It follows that 


/ Xs.BJq jt ) 

I d 




<2 


C 

Xs,B,Ja (0 


d^\og 



Finally, because d = 21ogB and limg^i+ logZ?/ (B — 1) = 1, the proof is complete. 
The proof of (|2T| is totally analogous and, therefore, omitted. 

Lemma 3. Let : K i—>■ M+ be given by @. Then we have 
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Proof. Observe that 

\k\>K \k\>K 

— (B '^^)^'exp 2 (iv 

< f f u^^^2Qxp(—u)du 

yJiK^B-y 

< 2-(2"+3)B^r (^2s+^,2K^B^-j'^ , 

as claimed. 

Corollary 1. Let co,J > 0; for x sufficiently large, it holds that 

.l=Jo 

Proof For x sufficiently large, the following limit holds 

r(5+l,vB-2i) 

lim —3—- L = 

see for instance IT] Formula 6.5.32, pag. 263. Therefore, we have: 

^ ^ B-(<o+2S)j < Cs,<oX^e-’‘B-^<^+^^^^. 

j=0 j=0 

The next result concerns the behaviour of the sums of the powers of the weights A 


7'?' 


Lemma 4. Let Qj and Xjq be so that Theorem^holds. For any j, it holds that 

Qi 

^jq ~ 1 ■ 

7=1 

Furthermore, let p > I and j > 0. It holds that 


Qi 




( 22 ) 


7=1 


Proof The hrst inequality follows directly the conditions in Theorem [T] On the 
other hand, for j > 0, it is immediate to see that 
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Qi Qi 

L K ^ rjPQjB-jP < riP-^Bj^^-P\ 

q=l q=l 

The next Lemma establishes explicit upper bounds for the sums with respect to q 
of differences between Mexican standard and truncated coefficients and for the I?- 
norms of the sums with respect to q of Mexican standard and truncated needlets. 


Lemma 5. For j > 0, it holds that 

Qj / 1 \ 

£ I Pj,-,sK - I" < 25 + -, 2K^B-^j Y. Tki (23) 

9=1 \ ^ / \k\>K 

< 2-(2^+i)77r (is + ^-,2K^B-^j^ . (24) 

Proof. For the Holder inequality, it holds that 


Qi 




9 

- Pjq-,s — Y ^j‘1 

Y wJ{kB ^f\akUk{^jq) 

9=1 

9=1 

\ ! \ T.r ' ' 

\k\>K 


Qi 

/ 


- E 

Y Ws({kB^-')^) \ak\\uk{t 


9=1 

\\k\>K ^ ^ 



9=1 \k\>K \k\>K 

< E^;9 E Y yk- 

9=1 \k\>K \k\>K 


Using Lemma and Lemma [pleads to the claimed result. As far as ( [24l i is con¬ 
cerned, we get 


iWjq-.sKiO) V/,'5;s(0)) — ^iq 



)uk{9) 



Using the orthogonality of {uf\ and Lemma|^yields to 
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\{Wjq-,sK ’/;9;s)||z,2C§n — H ') 


as claimed. 


6.2 Ancillary results related to Theorem ^ 

The lemmas here proved describe the behaviour of /i, I 2 and Hence, they are 
pivotal to study the bias Rs.K,j,ri ■ 

Lemma 6. Let /i be given by 

h : = 

Then, there exists Ci > 0 such that 


L L 

i>Jq=\ 


L2(S‘) 


h <CiB-’L 


Proof. Note preliminarily that 


A<E 

j>j 


Qj 

‘1=1 


L2(S1) 


Observe that, for the Holder inequality (see also El), we get 

(^E = (^E \M Wj‘i-A 0)\^\Vjq-AA\^^ 

^ Wj‘iAA\^ (^EJrw'(0)| 

i 2 

< CT73B3 ^ |r;^;.(0)|. 

‘1=1 


For C > 0 and using ([TOli, it follows that 
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Qj 

LP jq;sWjq-,! 

9=1 


Qj 


L2(S1) 


< CTJ2B2 ^ \Pjq-,s\ IIV^WilLusn 

n 9=1 ^ ^ 


Q 


< C ^ T] < CB- 

9=1 


Hence, we obtain 


^1.1 = E 

i>J 


9=1 


< Cl 2 B 


-rj 


9.2 (gl) 


Lemma 7. Let I 2 be given by 
h '■= 


J Qj 

E E A/9;-« iVfjq-,s-¥jq-,sK) 

i=2o9=l 


Z.2(S1) 


TTzen, f/zere ejczifi C 2 > 0 such that 

h < C272/:^"-2 exp 
Proof. First of all, observe 


J Qj 

EEA29 ;s - Wjq-,sK) 

9=4o9=1 


l 2 (S‘) 


< (7-70 + 1) L 
j=Jo 

using the Holder inequality, we have 


Qj 

E A/9;v (V^;9;^ “ 
9=1 


' 2 ; 


L2(s1) 


E I (V^i9;^' (0) - r29;^^ (®)) I ^ E (V^i9;^' (®) - V^99;^^ (®)) 


V9=l 


SO that 


Qj 


Y, lijq,^ iWjq-,s-Wjq^K) 
9=1 


L2(s1) \9=1 

Using ( |24| l in Lemmaj^and ( [T0| ), we obtain 


V9=l 

fQj 

E IAw'I 

V9=l 


^ f E |Ai9;/l E ||(r;9;-^-r79;. 


9=1 
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q=l 


L2(S1) 

SO that, from the Corollary [T] it follows 

j 

1 

j=Jo 






Hence, we get 

as claimed. 

Lemma 8. Let Ij be given by 


h '■= 

Then, there exists C 3 > 0 such that 


J Qj 

LL iPjqx - Pjq-sK) WjqxK 
j=Joq=t 


L2(S‘) 


/3 ^ 7 ^ 

\\k\>K / 


Proof. Observe that 


J Q, 


LL {i^jqx Pjq-sK)Wjq-,. 


w:sK 


3=70 9=1 


L2(S‘) 

Qj 


< (7-70 + 1) L 

J=Jo 


Y, iPjqX - PjqxK) Wjq-,sK 
9=1 


Z.2(Sl) 


Holder inequality leads to 


Qj (Qj 

Y \ {^iq-X-^iqxK)Wiq\sK(,d)\ < E 
,9=1 / \9=1 


PjqxKf \Wjq\sK {d)\ 





Q.i Qj 

YWjq-x.Kie)\<YWjq-Ao)\<CB^-^ 


9=1 


9=1 


We therefore obtain 
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SO that 

^ J 

< CB'^ ^ {^iq\s — ^jq-,sK) 11 11^1 tgl ) 

L2(S1) '?=! 

<CBir(2s+\,2K^B-^^') Y. Yk- 

\ ^ / \k\>K 

Using Corollary[T]leads to 

Y B^r f2s+-,2K^B-^^'\ exp (-2^:2) B-2(2 s-1)7^ 

j=Jo V 2 J 

Hence, we get 

\\k\>K J 

as claimed. 


Qj 

Y ~ Pj‘l,>^K) Wjq-,sK 
9=1 


6.3 Ancillary results related to Theorem ^ 

In this subsection we will summon auxiliary results connected to the proof Theorem 

El 

Lemma 9. Let Eu, £’ 1 , 2 , £ 1,3 and £ 1,4 be given respectively by ([n]), ([^ and 
Then, there exists Ce > 0 such that 

^ f n \ ^r+l 

£ 1 . 1 +£ 1 . 2 +£ 1 , 3 +£’ 1,4 <C£ -- I 

Vlogny 

Proof. Observe that 

( Jn Qj \ 

\ 7 = 09=1 / 

Splitting the sum into two parts by means of the so-called optimal bandwidth selec¬ 
tion, given by 7i „ ; " = (n/logn)2t+T, and using ( |2^ yields to 

Jl.n Qj J 

BnYlL ^{\^j,,K„\>'^} ^ <C{n/\ogn)^, 

7 = 09=1 


and, on the other hand. 
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j=Jl — ' ' 


Jn Qj 


|2 /K-T„\-2 


j=Jl.n 7=1 

< c'— 

logn 


< C' 


logn 


1 

JF+T 


( ^ 


■27TT 


It follows 

E\,\ < Cl 1 I -- 

Vlogn^ 

As far as £12 is concerned, standard calculations using (|27|i lead to 


Jn Qj 


Pjq;sK„ l^jil-,sKn 


1 


{ I PjiJ.sl^n Pjil,sK„ I > K-r,, /2| 


Cl,2 —y^. y^. 

7=07=1 

Jn Qj . 

< Crin £ £ E2 

./=()7=1 

5 5 1 5 

< C' ^ < Ci.2^h (log^)~ 

7=0 



4' 

1 


KTn 



P2 

l^jq-sKn ~ l^jq;sK„ 



On the other hand, we obtain 
Jn Qj 


C1.3 = 'nnY,Y, \Pj‘l\^Kn\ E 1 


7 = 07=1 

<Ci3n-^||£||2,(g,), 




Finally, we get 


C1.4 < CT7„ £ ^ \l^ji!-,sKn\ ^{\lij^.^\<2Kt„} 
7=07=1 

7l,n Qj J„ Qj 

<c£ £ |2K-T„p+t7« £ £ 


7 = 07=1 


< C' bC,„ 


logn 


7=7i,„ 7=1 

-1 Jn '' 

+ £ B-2r7 

j—-^ 1 ,rt / 


SO that 


Cl ,4 < Cl,4 


/ n 


\logn 


as claimed. 
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The next result was originally presented in ||3l as Lemma 16, hence the proof is here 
omitted. 

Lemma 10. Let o be a finite positive constant such that 

O’> (ll-f’llL-dsi) II • 


Then, there exists constants cp,CE,C > 0 such that, for ^, the following 

inequalities hold 


Pjq;sK„ 


'jy,sK„ 


> X 


< 2 exp 


: + cpxBi'j j 


E 


Pjq-,sK„ Pjq-,sK„ 


<CEn ^ 


(25) 

(26) 




-P 


'jq-,sK„ 


> 


KTn 

2 


< Cn 


-S 


(27) 


where 5 > 6(7^. 
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